Papers with sub-word units
A LSTM Approach with Sub-Word Embeddings for Mongolian Phrase Break Prediction (C18-1)
Copied to clipboard
| Challenge: | Existing word embedding methods for Mongolian PB prediction are expensive and time-consuming. |
| Approach: | They propose to use Mongolian word embedding to build a robust Mongolian PB prediction model . they encode sub-word units and feed it to LSTM to decode the best corresponding PB label . |
| Outcome: | The proposed model outperforms traditional model using manual features and achieves 7.49% gain. |
Evaluating the Impact of Sub-word Information and Cross-lingual Word Embeddings on Mi’kmaq Language Modelling (2020.lrec-1)
Copied to clipboard
| Challenge: | Mi'kmaq is an Indigenous language spoken primarily in Eastern Canada. |
| Approach: | They consider n-gram and RNN language models for Mi'kmaq and use them to investigate their performance. |
| Outcome: | The proposed model performs better than word-level models, but does not improve over word-based models. |
Do NLP Models Know Numbers? Probing Numeracy in Embeddings (D19-1)
Copied to clipboard
| Challenge: | Existing models cannot capture numeracy, but they can be useful for complex reasoning tasks. |
| Approach: | They investigate numerical reasoning capabilities of a question-answering model . they probe token embedding methods on synthetic list maximum, number decoding, and addition tasks. |
| Outcome: | The proposed model excels on questions that require numerical reasoning, i.e., it already captures numeracy. |